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ABSTRACT \ 

The Primary Edupation Project (PEP) is concerned with 
the development and evaluation of a model of individualized education 
for young children suitable for Implementation in American public 
schools at the preschool through primary grade level. It is concerned 
with all aspects of school functioning: curriculum, classroom 
organization, teacher training and staff development, and' work with 
parents. The PEP curricula emphasizes basic skills and concepts often 
measured in intelligence and aptitude tests, and includes basic 
perceptual-motor skills, Ic^^nguage concepts and logical processes 
concepts of number as well 'as fundamentals of reading. 
(Author/DEP) 
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PEP IN THE FRICK ELEMENTARY SCHOOL: 
INTERIM EVALUATION REPORT , 



Margaret C. Wang, Lauren B* Resnick, and Patricia R. Schuetz 

Learning Research and Development Center 
University of Pittsburgh 



Introduction 

The Primary Educahon Project (PEP) is concerned with the 
development and evaluation of a model of individualized education for 
young children suitable for m.plementation in American public schools. 
The project is a joint undertaking of the University of Pittsburgh and the 
Pittsburgh Public Schools. The primary object of PEP is to develop an 
indtvidualized early learning program to serve children from preschool 
through the primary grades. The PEP individualized instructional model 
has been under development at Frick Elementary School in Pittsburgh 
since September 1967. It is concerned with all aspects of school func- 
tioning- -curriculum, classroom organization, teacher training and staff 
development, and work with parents. The instructional model ircorpo- 
rates both developmental work and basic research with respect to the 
concerns of school functioning. 

Initial work in PEP has focused on the development and evaluation 
of hierarchically sequenced curricula which promote early and continued 
success in learning by assuring that key prerequisites for successive 
levels of achievement are established before each new step is taken. 
The PEP early learning curricula emphasize basic skills and concepts 
that underlie a variety of subject matters. These are skills and concepts 
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often measured m intelligence and aptitude te&ts, and include basic per- 
ceptual-motor skills, language concepts and logical processes, concepts 
of number, etc. , as well as the fundamentals of reading (Resnick, 1967). 

Based on the objectives specified for each of the PEP curriculum 
areas, criterion-referenced placement and diagnostic te^ts have been 
developed for use in a testing program designed to diagnose and monitor 
each child's learning progress in the PEP curriculum. In actual use in 
the classroom, testing is informal and individual, and continues through- 
out the school year, as a child completes an objective or unit of objectives, 
he IS pretested to establish a new starting point for further work. 

Instructional procedures in PEP classrooms vary according to 
age group. In general, the school day begins with a "prescribed learning 
period, " in which children work on individual assignments developed for 
each child on the basis of placement and diagnostic tests. A variety of 
materials are used, some borrowed from Montessori and English infant 
school programs, some designed by the PEP Research and Development 
Staff, and many constructed by the teachers. Children are taught to fol- 
low the prescripticnj with considerable autonomy, sequencing their activi- 
ties, locating work materials, s'electing an appropriate place to work, 
and requesting help as needed. 

Following the prescribed learning period, there is in many class- 
rooms an "exploratoiy learning period" in which children are free to 
choose their own tasks from a variety available in the classroom. There 
IS no sharp time division between the two periods. Children move from 
one period to the other as they finish their prescribed assignments. 
Exploratory tasks include construction, socio- dramatic play, creative 
artwork, science and mathematics experiments, soci-al studies projects, 
writing or dictating stones, and other language arts activities. The pur- 
pose iS both to permit the child to apply his basic skills in a variety of 



contexts, and to stimulate interest in new kinds of learning activities, A 
long-range goal of the PEP research program is to investigate appropri- 
ate ways of combining prescriptive and exploratory modes of learning so 
as to maximize educational growth in many dimensions, 

F rj.ck School 

0 

Frick Elementary School, the developmental school for PEP, is 
a Pittsburgh Public School situated near the University of Pittsburgh, 
All of the Frick students live in the inner-city neighborhood in which the 
school IS located. The majority of students ai-e from economically dis- 
advantaged families, a large proportion of them living in public housing 
•projects within walking distance of .the school. A small percentage of 
the Frick students are children of university faculty, staff, and graduate ' 
students, and other professional people. 

Socioeconomic Data 

Tables 1 to 4 summarize the socioeconomic background of the 
children who attended PEP classes during the 1969;1970 scho^oljrear. 
These data were obtained from the student registration forms, which 
parents or guardians are required to complete in the school clerk^s 
office when the child is enrolled. As indicated in Table 1, between 17 
and 38 percent of the children come from families with no father present. 
There was a large difference between preschool and kindergarten chil- 
dren and first grade children in the percentage of fathers at home. This 
may be explained by the fact that a number of children of university 
faculty and staff members attend Frick preschool and kindergarten 
classes but transfer to private schools when they reach first grade. 
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TABLE 1 

Proportion of PEP Fathers Living at Home 





Preschool 


Kindergarten 


First Grade 


Averaqe 


Fathers at home 


83,1% 


75.9% 


58.9% 


74.2% 


Fathers not at home 










Deceased 


ao 


2.6 


2.9 


2.3 


Absent 


16.9 


21.5 


38.2 


23.5 



Of the children attending PEP classes, 83.8 percent were black 
(see Table 2). Of those fathers at home fo^ whom information v/as avail- 
able, the rnedian occupation level was that of a semi- skill -»d worker 



TABLE 2 
Racial Breakdown of PEP Students 



Preschool 



Kindergarten 



First Grade 



1. Black 
Z White 
3 Other 



78.1% 
17.3 
4.1 



85.3% 
13.8 
09 



89.9% 
9.3 
0.8 
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(Table 3). a category which mcludes such occupations as machine opera- 
tors, truckers, and security guards^ The occupational scale is based on 
Holhngshead's (1949) Occupational Categories* The median educational 
level of these fathers was that of a high school graduate (see Table 4). 
The occupation and education levels are somewhat higher than might be 
expected m an inner -city neighborhood sucn as Frick*s* However, it 
should be noted that the data are based only on those fathers who were 
reported to be living at home. Furthermore, even among the fathers 
who were reported at home, there was a large proportion for whom no 
information was available. It ^eems likely that most of these omitted 
cases foil in the lower educational and occupational levels. 



TABLE 3 

Occupational Levels of Fathers Living at Home 



Category 


Preschool 


Kindergarten 


First Grade 


Average 


1. Executive and Professional 


4.6% 


4.3% 


2.3% 


3.8% 


2. Managerial, proprietors of 
medium-sized businesses 
and graduate students 


6.2 


2.6 


2.3 


3.3 


3. Minor professional and small 
independent businessmen 


1.5 


3.4 


47 


3.8 


4. Clerical, sales and technicians 


7,7 


8.6 


6.7 


8.1 


5, Skilled labor and services 


10.8 


8.6 


7.8 


9.0 


6. Semi skilled labor 


23.1 


23 3 


18.6 


21.3 


7. Unskilled labor 


26.2 


20.7 


16.3 


19,9 


8. Unemployed 


6.2 


5.2 


7.0 


6.2 


9. No information 


13.8 


23.3 


34.9 


24.6 



^Figures reported in this table are bdscd on the "fathers at home," as reported in Table 1. 




TABLE 4 

Educational Levels of Fathers Living at Home^ 





Preschool 


Kindergarten 


First Grade 


Average 


1.^ Graduate degree 


4 6% 


4.3% 


0.8% 


2.9% 


2, Graduate school 


77 


/ 1-7 


1.6 


. 2.9 


3. College graduate 


.0 


1.7 


2.3 . 


1.6 


4, High school + 


7.7 


12.1 


9.3 


10.0 


5. High school graduate 


32.3 


56.0 


48.1 


47.7 


6. 9th- 12th grade 


9.2 


15,5 


25.6 


18.4 


7. 7th - 9th grade 


1.5 


4.3 


6.2 


4.5 


8. Below grade 6 


1.5 


.9 


2.3 


1.6 


9. No fnfornn£tion 


35.4 


3.4 


3.9 


/ 10.3 



^Information was not available for most absent fathers. Figures reported in this table are based on the 
"fathers at home/' as reported in Table 1 . 



Description of the PEP 1969-1970 Cla s ses 

Pre - Kinde rga rten . There were 23 children enrolled in the two 
classes for three-year- olds at Frick* The school day for the three-year- 
olds was from 12:30 to 3:30 p.m., Monday through Thursday. The total 
number of children enrolled m the four-year-old program was 33. Twenty 
two of the children, randomly assigned to the two classes, had had one 
previous year with PEP. The average teacher- child ratio for the classes 
was 8.25 (a teacher and a teacher^s aide were p'"esent in each class of 
16 or 17 children). The four-year-olds met from 8:30 a. m. to 11:30 
a. m. . Monday through Friday. 
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Kindergarten. There were six PEP kindergarten classes. Three 
met from 8;30 a.m. to 11:30 a.m., Monday through Thursday. Children 
whofce fifth birthday fell on or before June 30 were assigned to the morning 
group, while those whose birth dates fell on or after July 1 were assigned 
to the afternoon group. Thus, children in the afternoon group were six 
months younger, on the average, than those in the morning classes. 

There were a total of 56 children enrolled in the afternoon classes. 
Sixteen, distributed randomly among the classes, had had previous PEP 
experience. The afternoon groups averaged about 19 children per class. 
Lach class had a' teacher and an assistant teacher. There were a total 
of 5ii children enrolled in the morning kindergarten class, with an average 
class size of 17. Twenty-five children had previous experience with the 
PEP program. These children were randomly distributed among the 
classes. 

First Grade. A total of 133 children were enrolled in five first 
grade PEP classes at Frick. Of these, 104 had attended PEP kindergar- 
ten the previous year, while 29 were new to the program. Each class had 
approximately 27 pupils, a teacher, and an assistant teacher. Children 
were assigned to classes randomly with no ability grouping of any kind. 
First grade classes met from 8:30 a.m. to 3:30 p.m. {with a one-hour 
lunch break at noon), Monday through Friday. 

The 1969-1970 PEP Curriculum 

Mathematics 

The PEP Quantification curriculum and the lower levels of the 
IPI Mathemr.tics curriculum served as the core for the mathematics pro- 
gram in PEP classrooms during the 1969-1970 school year. The PEP 
Quantification curriculum consists of 14 units: The first 8 units are 




designed to d'evelop an operational number concept for sets up to ten, 
"while Units 9 through 14 introduce higher numbers together with princi- 
ples of grouping and place value fundamental to the decimal number sys- 
tem. Table 5 outlines the content of each of the 14 units. The methods 
used m deriving and sequencing objectives, together with a detailed 
rationale for Units 1-8 appear in a paper by Resnxck, Wang, and Kaplan 
(1973). The Quantification curriculum was used in all PEP classrooms. 



TABLE 5 



Beginning Mathematics Program 
1969-1970 



Topic 


Number of Objectives 


Quantification 




L Counting 


9 


Unit 1 - counting (1-5) / 


Unit 2- counting (6-10) / 


9 


Unit 9 - counting {11-20) 


4 


Unit 11 - counting {21-100) 


8 


Unit 13- counting (101-1000) 


5 


II. Numeration 




Unit 3 - numeration (1-5) 


7 


Unit 4 - numeration (6-10) 


7 


Unit 10 - numeration (11-20) 


5 


Unit 12- numeration (21-100) 


IS 


Unit 14 - numeration (101-1000) 


12 






Unit 5 - comparison of set size 


6 


Unit 6 - seriation 


4 



IV. Addition and Subtraction 

Unit 7 - addition and subtraction 7 
Unit 8 - addition and subtraction equations 6 



Total number of objectives , 104 
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The B And C levels of the IPI (Individually Prescribed Instruction) 
Math curriculum were introduced to those children who completed all 
units in PEP Quantification. Topics included in Levels B and C of IPI 
Mathematics are numeration, place value, addition and subtraction, 
fractions, money, time, multiplication, division, systems of measure- 
ment, and geometry. Table 6 summarizes the content covered and lists 
the number of objectives in each unit. The IPI Mathematics curriculum 
IS described and discussed more fully in a paper by Lindvall and Bolvin 
(1967). 





TA8LE 6 1 






IPl Mathematics Curriculum Used in t^ 


e PEP Classes at Frick 




1969-1970 




Unit 


Topic 


Number of Objectives 


Level 8 




10 


8--1 


Numeration 


8^2 


Place Value 


3 


8-3 


Addition and Subtraction 


10 


8-4 


Fractions 


2 


8-5 


Money 




8-6 


Time 


3 


8-7 


Systems of Measurement 


4 


8-8 


Geometry 


2 


Total Number of Objectives \ 


38 



Level C 




7 


C-- 1 


Numeration 


C- 2 


Place Value 


5 


C- 3 


Addition 


5 


C- 4 


Subtraction 


• 4 


C- 5 


Combination of Processes 


6 


C- 6 


^^ractions 


4 


C-^ 7 


Money 


4 


C- 8 


Time 


2 


C- 9 


Systems of Measurement 


2 


C- 10 


Geometry 


2 


C- 11 


Special Topics 


1 


Total Number of Objectives 


43 
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Classification ' • * 

The PEP Classification curriculum is divided into three sections. 
CJiiSsification Ixovers the basic concepts of ' same" and ^'different" 
together with color, size, and shape discrimination. Classification II . 
includes a number of specific language objectives. Classification III 
covers advanced discrimination and multidimensional classification skillo. 
Table 7 summarizes the content of the three sections of the Classification 
curriculum. Thi^ curriculum was. used with all children in preschool and 
kindergarten .classes, and in first grade with children identified by teachers 
as needing special work in these areas^ > 



TABLE 7 

Classification Program 
1969-1970 





Topic 


Number of Objectives 




Classification t 


/ 




Matching SkiHs 

Unit 1 -.basic matching skills * 
Unit 3 - advanced matching skills 


/ 

5 
4 




Discrimination Skills 

Unit 2 - sh9pe and size discrimination 

Unit 4 — color naniing 

Unit 5 - shape naming 

Unit 6 - size description 

Unit 7 - advanced discrimination skills 


4 
2 
2 
4 

12 




Total Number of Objectives 


33 




Classification II 






Identity Statements 

Unit 1 - singular and plural 
Unit 2 negative 


4 > 
3 




Prepositional Statements 
Units 3 and 4 - propositions 


16 




Total Number of Objectives 


23 




Classification HI 


\ 




Unit 1 — advanced color, size and shape discrimination 
Unit 2 - functional category discrimination 
Unit 3 category naming 


9 
11 
8 




Total Number of Objectives 


28 



\ 
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I r< «-|>"'i ' I - I Vi"! '> r Sk ills 
I Tlio ixTCopt.ial'-n.olor sku.s program used (luring 1969-1970 - 

i,„'l..<lo<l ll,<«.u<-.n< ral motor ..nd visual skills components of the program 
, oullim-d by H6sn.T (l-K.V). Tl..- «cn<-.ral motor skills curriculum is con- 
■c,.r,.c.<l with both Kro.^ ami fmc motor <lcvclcpmcnt of the preschool child. 
I, contains SK obj.-i t, v.-s" ;n ri^ht units. The visual skills curriculum is 
,j,..si«nod to t.M.J. various disi rimin.ition tasks involving position and 
/,>M.ntation in a' spat.al matrix. The- program is built' around a carefully 
Hr=..k-d s<qu.M.c-.- of patlorn r.-production activities. There are 83 objec- 
l.vrs ... s.-von ..nits. Hu.se programs wore .mplemented in the various 
|.p;p < U.sM-s on an ..xp.-rimcntal basis at different periods during the 
Hchool yoa r. 

Heading . ' 


Children .n IMiP first grades received reading instruction using 
a Specially designed "ISarly Uead.ng Program" (ERP). followed by the 
M'cdraw-ll.ll Sullivan Associates' Pr..K rammed l<.:adinjLScries. PEP 
reading .n.s. rucM ,on stress'ed v^ord .lecoding skills. ERP teaches children 
Skills <.f s<A,ndin,. out ami bleml.ng, It involves Individual tutorial sessions 
at the outset, w.lh children movi..g gradually into small groups and then 
bac-k into i,«r.vidual work .n ll.e m-adinyj!.™. The reading program 
was formally .nsliluled m the first grade classes beginning in January 
|«>7(). liecause of the tutorial nature of the program, not all children 
;'l,..«a.. i..s(. uelio„ ..t the sa.ne t.me: however, virtually all children in 
■ fi rsl g. ade l.a.l begun work .n.EKP by the end of the school year. The 

rat.o..ale for ll.e 1>F,P reading program is given in a paper by Beck (1970). 

Suniiiiiaj;i_<>f_C>LL'lL9i'Iiliil 

r,,l,le H su.n.,.ari/.es the core curriculum areas included for 
,.;,eh g.Mde level d.irii.g Ihe 1969-1970 school year. 
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TABLE 8 



Summary of Curriculum Components Used at Each Grade Level 



Curriculum Components 


Preschool 


Kindergarten 


First Grade 


1. PEP Quantification 


X 


X 


X 


2, IP! Math 






Some advanced students 


3. Classification , 


X 


X 


Special A/ork for a few ^ 


4. Perceptual Skills 


X* 


x; 


X* 


5. Reading 






X 



*0n e perimental basis 



The PEP Testing Program 

The PEP Testing Program, designed to assess and monitor 
student learning progress in each of the PEP curriculum areas, includes 
a placement and a diagnostic pre- and posttest battery (V/ang, 1969). 
The placement test battery was used at the beginning of the school year 
to place a particular child in the sequence of instructional units included 
m each of the PEP curriculum areas. The placements were also admin- 
istered to new students who entered the program during the school year. 

The diagnostic tests were used to determine which particular sets 
of'objectives withm a unit a child needed to work on and, following instruc- 
tion, whether he had mastered those objectives. After a child was placed 
m a given unit ibased on the placement test results), the child was given 
the diagnostic tests for the objectives included in that unit to determine 
what particular objective(s) he needed to work on. During pretest and 
the first posttest, the child was given the diagnostic test only for the 
terminal objective{s) of any given unit. However, if the child failed to 
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pass the posttest a second time, he was given the diagnostic test for 
every objective included in that particular unit to determine further work 
in the unit. Diagnostic tests were administered to children orally and 
individually. Testing was carried out informally in the classroom setting 
by one of the adults in the classroom (the teacher or fhe assistant teacher). 
The amount of time spent on testing varied from child to child and from 
age group to age group. On the average, a kindergarten or first grade 
child took three tests per test session; sessions lasted about eight min- 
utes for kindergarteners, and about nine minutes for first grade children 
(Wang & Schuetz, 1970). 

St uden t Learning Outcomes 

Two basic kinds of data are available for assessing student learn- 
ing outcomes in the PEP program: (1) records of performance on the 
placement and diagnostic tests included as part of the various curricula; 
and (2) scores on standardized achievement tests administered at the end 
of the school year. In this section, we shall examine both of thes^t^pes 
of data, making 'pertain comparisons among various PEP groupf' and 
between PEP and non-PEP classes. In the following section, we examine 
the relationship between achievement and various possible predictors of 
learning success, such as socioeconomic variables, IQ, and entering 
performance level as measured by placement tests. We also examine 
here the relationship between performance on the PEP curricula and 
performance on standardized tests. 

Learning Pro^ rress in the PEP Curricula 

Mathematics . Table 9 shows the percentage of children at each 
age level who had mastered each unit (i.e. , passed the terminal test(s) 
^f a given unit) in the Math curriculum at the end of the school year. 
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TABLE 9 



Percent of Students Mastering Each Unit in the 
Quantification and the IPI Mathematics Curriculum at End of School Year 
. 1969.1970 











Age Group ^ , 




Unit 


3 yrs. 
N=23 


4 yrs. 
N'33 


Kindergarten p.m. Kindergarten a.m. 
N-56 N=52 


First Grade 
N=133 



Quantification 



1. Counting 1-5 


59 


81 


93 


100 


93 


2, Counting l-lO 


32 


78 


88 


100 


91 


3. Numeration 0-5 


36 


75 


88 


90 


93 


4. Numeration 6-10 


18 


'56 


81 


92 


81 


* 5. Comparison of sets 


9 


47 


90 


85 


85 


6. Seriation 


14 


34 


70 


77 


77 


7. Addition and Subtraction 


5 


6 


49 


56 


83 


8. Addition and Subtraction 












equations 






12 


21 


28 


9. Counting 11-20 


5 


28 


58 


58 


93 


10. Numeration 11-20 




6 


47 


60 


86 


11. Counting 20-100 






21 


27 


56 


12. Numeration 20-100 






4 


10 


38 


13. Counting 100-1000 








4 


19 


14. Numeration 










15 



IPI 



Level B 
Leyel 0 



As can be seen, there ib a steady increase with age in the percentage of 
students mastering each unit. With respect to content mastered, Table 
9 shows that almost all first-grade and about Waif of the kindergarten 
children could perform addition and subtraction operations with quantities 
up to ten (Unit 7); and many children were well advanced in work with 
higher numbers. Pre-kindergarten children worked mainly in the lower 
units, learning counting, numerals, and one-to'one correspondence; but, 
as can be seen, individual children ^n the three- and four*year-old groups 
were able to advance to. addition and subtraction and work with larger 
numbers. 

The relatively low percentage of children in preschool and kin- 
dergarten classes passing Unit V, and especially Unit 8, reflects teadhers 

M 17 
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decisions to let some children skip over these relatively difficult units 
temporarily and return to them later. A finding of this kind usually indi- 
cates some misordering in the curriculum. In this case, certain pre- 
requisites for ~Unit 8 had not been adequately learned. While skipping 
the unit and returning later was encouraged as a means of immediate 
adaptation, the R & D staff has also begun to investigate and make revi- 
sions designed to. correct the problem. The revisions will be incorporated 
in a later version of the Mathematics curriculum. 

Table 10 shows the total number of instructional objectives mas- 
tered at the beginning of the school year (the entry level) and the total 
number of instructional objectives mastered by the end of the school year 
(terminal mastery) for each age group. As the table shows, there is a 
consistent pattern o/ increase with age in both the entry and the terminal 
levels of mastery. Figure 1 shows these results graphically. 



TABLE 10 

Entry and Terminal Mastery Levels in Quantification 



Number of Instructional Obiectives Mastered 
Entry Terminal 



Age Grouo 


N 


X 


S.D 


X 


S.D. 


3*year-olds 


23 






12.09 


13.17 


4-yec' olds 


33 


.64 


2.22 


29.36 


16.09 


Kindergarten p.m. 


56 


2.70 


5.78^ 


44.19 


1 23 


Kindergarten a.m. 


52 


3.74 


6.60 


50.94 


25.66 


First Grdde 


133 


16.98 


16 07 


57.80 


23.65 



4 
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One test of the effectiveness of the Quantification program comes 
from comparing the Fall entry level for students who had previous PEP 
experience with that of students who had not attended PEP classes. 
Table 11 shows these comparisons, giving the number of individual objec- 
tives mastered on the entering placement test for kindergarten children 
with and without PEP preschool and first graders with and without PEP 
kindergarten. As shown in Table 11, children at both grade levels who 
had a previous year of PEP performed significantly (p < . 01) better on 
the Quantification placement tests than the new students. 



TABLE 11 



Comparison of the Quantification Entering Mastery Levels of the Students 
With and Without Prior PEP Experience 
Placement Test Results, Fall 1969 



Previous year in PEP New to PEP 

Mean number of Mean riumber of 

Grade Level N objectives mastered N objectives mastered t-test d.f. Significance Level 

Kindergarten 41 4.98 69 2.01 2.58 1 08 .01 

First Grade 104 18.95 79 9.90 2.92 131 .005 



Classificati on. To examine student progress in the Classification 
curriculum, analyses of student learning outcome wei?e performed simi- 
lar to those described for the Quantification curricula. The results are 
reported in Tabic 12. First grade data are not included in the table 
because Classification was not used on a regular basis for all children 
at that level. 

\ 
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TABLE 12 



Student Mastery Summary 
Percent of Students Mastering Each Unit of the 
Classification Curriculum at End of School Year 
1969 19,0 



Group 



Unit 


3 yr. -old 4 yr. -old 
N=23 N=33 


Kindergarten P m. 
N-56 


Kindergarten a.m. 
N=52 




Classification 1 




- 


1, Matching 


77 75 


95 


90 


2. Simple classification 


41 66 


95 


94 


3. Classification of objects 








varying in 2 dimensions 


50 72 


96 


90 


4. Color naming 


41 59 


91 


93 


5. Shape naming 


41 56 


88 


92 


6. Size description 


9 25 


68 


73 


7. Advanced classification 


19 


65 


71 




Classification M 






1. Singular and plural obj 


19 


74 


75 


2. Reverse order ident. 


3 


63 


63 


3< Prepositional statemt. 




' 57 


56 




Classification ItT* 






1, Multi-dimensional classification 


58 


71 


2. Classification of functional categories 


47 


71 


3. Category naming 




53 


65 



*Unit not Included in the curriculum for this age group. 
••Classification 111 was not used in preschool and kindergarten. 



As for Classification, increase in the mastery level with age is 
apparent (Table IZ). As an example. 50 percent of the three-year-olds 
mastered the unit on the classification of objects varying in two dimen- 
sions, while IZ percent of the four-year -olds and 90 percent of both kin- 
dexgarten groups mastered the same unit. 

A comparison was made of the entering mastery level of kinder- 
\garten children v/ho had a year of PEP nursery school NVith that of the 
'children who were new to PEP. The returning PEP students scored sig- 
nificantly higher (X = 11. 3) than new (X ^ 6. 94) on the Classification 
\ 




placement test given at the beginning of the school year. The differences 
were statistically significant (p<..0005). 

Perceptual Skills . Since the program was used with selected chil- 
dren and on an experimental basis, no summary data are reported here. 
The results from the experimental trials are reported in a paper by 
. Rosner (1972). 

Re ading . Table 13 gives the percentage of first grade children 
who had completed each successive level of the reading program. Rather 
low terminal mastery levels in the reading program are a function of the 
late mtroduction of formal reading instruction during the school year. 



TABLE 13 

Student Mastery Summary* 
Percent of Students Mastering Each 
' Book of the McGraw-Hill. Sullivan Reading Series 



Grade 1 

Unit "^OP'C . N=133 
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1. First transitional reader ^^-^ 

2. Second transitional reader ^^-^ 

3. Initial and final consonant clusters; contractions 48.9 

4. "ed" suffix of past tense verbs ^ 40.6 

5. Inflectional and derivational suffixes "cs"^ and "er" 31.6 

6. Inflectional and derivational suffi>:es "et" and "est". 

complex sentence structure: paragraphs 22.6 

7. New initial and final consonant clusters; suffix "ay" 13.5 

8. Short "o"; "2" and "qu"; poems, descriptive paragraphs. ^ 

short stories, colon ^ ^9*5 

9. Final "y": long "a" with final silent "e": soft "c" - o-G 

10. Long "i" and "o": soft "g": longer stories 6.0 

1 1. Long vowels not followed by final silent "e"; long "u" 6,0 

12. Words ending in "oy" and "igh", animal sounds, concepts 

. ."bright" and "pale" 4.5 

13. ^"e]B";4ongef selections on natural sciences, with emphasis 

onlcomprehension and retention; semi colon 3.0 

14. "ew". "oo", descriptions of natural phenomena and human 

institutions, with emphasis on comprehension and retention 3.0 

15. "ow". "ea". "wh", "ph", Jlent "t" and "w", "kn". "ch": 

suffixes "ture" . "ation": months and seasons' 1.5 

16. "ould". "dge". s 'I" and "h". "wr". usage of "could" 

"should" and "would"; history, with emphasis on com- 
prehension and retention ^-^ 



Some children began work on ERP as late as April. As will be seen, the 
late start is also reflected in standardized achievement scores, which are 
low relative to mathennatics jcores. 

Performance on Standardized Achievement Measures 

So far, in this paper, we have addressed ourselves to questions 
related to student learning progress in the context of the PEP curriculum, 
using only our own criterion-referenced evaluation measures. We will 
now turn to the issue of how the PEP students rank in comparison with 
other students of their age and grade level based on national norms. 

The Wide Range Achievement Test (WRAT) was selected as the 
standardized norm-refe renced achievement test for thii> purpose. WRAT 

was chosen for the following reasons: (1) Amon^ the available standard- 
ized tests. WRAT items, with the exception of the spelling subtest, reflect 
most closely the content covered by the PEP curriculum objectives- -this 
is especially true in tlie lower grade levels; (2) WRAT is relatively easy 
to administer and the testing time required to administer the test is not 
extensive; (3) for longitudinal evaluation of PEP, the WRAT, a single 
test that covers the span from nursery through high s.chool grades, may 
be a more valid test to use for the purpose of evaluating the wide range 
span of student learning outcomes that an individualized program such 
as PEP expects to achieve; (4) WRAT provides us with comparison data 
on a nationwide basis. (The national evaluation program for Project 
Follow Through also includes WRAT in its testing battery. Project Fol- 
low Through is funded by the U.S. Office of Education and PEP was 
Selected as one of the sponsoring models. ) 

All three Level I«subtests of the WRAT (reading, spelling, and 
arithmetic) were administered to all PEP kindergarten and first grade 





classes in May 1970. The reading subtest requires recognizing and nam- 
ing letters and recognizing words, the spelling subtest requires copying 
marks resembling letters, writing one's name, and writing single die- ^ 
tated \^rords; and the arithmetic subtest tests counting, reading numerals, 
solving oral problems, and performing written computations. Specifically, 
to compare the content covered by the W RAT with the PEP kindergarten 
curriculum objectives, items included in the arithmetic subtest were 
directly "taught for" in the PEP kindergarten classes, and some of the 
reading "readiness" skills tested in WRAT were included in the PEP 
Classification curriculum. In first grade, both arithmetic and reading 
were taught, but the reading program did not begin in the first gr-de 
classrooms until late in January 1970, so that at the time the V^RnT was 
administered the first graders had only three to four months of reading 
instruction. Spelling was not included in either the kindergarten or the 
first grade curriculum, although some of the skills included in the PEP 
Perceptual Skills Program were relevant to the lower level spelling tasks. 

The WRAT was also administered to second and third P'-ade classes 
at Frick in May 1970. These classes, none of which had previously had 
the PEP Program, provide a natural "control group." Since they are 
drawn from exactly the same neighborhood » it was assumed that second 
and third grade children would closely match first graders in socio- 
economic and other relevant student characteristics, such as ethno- 
cultural backgrounds. 

Since the initial plan for the implementation of PEP in Frlck 
School was designed to begin the implementation at the lowest grades 
(preschool and kindergarten) and move into one more grade hierarchically 
for evaluation purposes, the grade one year ahead of the highest PEP 
grade seems to be the most appropriate comparison group from a practi- 
cal as well as a validity standpoint. Therefore, our evaluation plan calls 



ERLC 



\ 

\ 



for Ihc comparison «)f .u liirvt riicnl n sull.s for lfn PKI* ( lassrs .wu! Hit ' 
iion-PKP clasiit's of lln' saim 1^ vt I of the previous year. Unfor* 

Icinaldy. w<» arc rn»\ able lo (.oni|)«irt ,hr WKA'I' m .sciMs t)f tin* IMII^ firsl 
,4ra(li- 1*)7()) and llial i>f llu nun I >IJ > f ii si uracil' {\')CH- \%')), sjm.r 

wo tlicl ni»l u»vr llir VV KA I' lo llu non-Pi;!* firsl i;raelr Uassi .s in I968-I9^>9. 
Ncvi-rl lii N'Ss. txaiiiinahon of second .ind (liird u'^^dt scons for Spring 
l*)70 pr«>vidi's an infoirnal basis for «i.ssessini; iUv pow( r of 1M\I* inlrr- 
vonlion. 

rabli- 14 shows (he mean r«iw store wilb sbmtlartl deviation, and 
(lie mean ^rach eqmvalcnl for each of lh( WKA'I suble^ls for PF.P kinder- 
1^,1 rlrn and firsl >4 r.uh thildren and for non-Pi". P set ond .md (bird graders* 
The median u«»ve eipnvalenl data as shovvn j^rapbically in I'l^^Mre As 
rcporletl m fable 14. kuuIoru«» rtenu rs pe rforiiK d conifort.ibly <il)ovo Ibe 
expected achievonioni of kinduru'trUn children on holb reading and arilh- 
nicljc sublesLs (a K>*«^do ecjUivalcnl of K, 9 would be JusI average for M.iy 
of Ihc. kindt rgn rion year), Hiey scored aboiil one monlh <ibead of grade 
level in reailing and five monllis ahead in arilhmelic. 

Firsl graders perforriied abo«:l two months .ibea<l of lUc'ir grade 
level in arilbmelic. the area in which (heir insl ru< iion.il program wa.s 
besi developed. In reading they performed no! quite <H (be grade level. 
VUr grafle e<piiv.»leiit si ore sliows about one iu4)iilh behm<l, 'riu'-t resull 
must be- interpreted m Ibe light of the late start in re.uling instruction in 
FM'.P (lasses. Inslrtiction began wi January, with many 1n<li vi<lua I s begin- 
ning later, so llial by the time Ibe test was adtni ni si e n <1 . children had 
receive<l from /.ero to five monlbs of instruct ion r^Ubei than the "norm.il" 
nine tnonlhs. Tin- Ihird gr.ulers pevformefl aboeit nine tnonlbs Ixdiind 
their grade level in reading. Tbi results seem /o soggest that the non- 
PK1> classes al I' ncK show evidence of a devi lopmg "emulative deficil" 
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while PEP classes .show promise of having broken the cycle by perform- 
ing strpngly in the first grade/ 

In order to be certain that the observed differences between PEP 
and non-PEP classes were not functions of the differences in socioeco- 
nomic status of the two groupr, a comparison was made of WRAT scores 
of those PEP students who had siblings in the second or third grades and 
scores of their older siblings. Table 15 reports the mean raw score, 
median grade equivalent, and median.percentile rank of each WRAT sub- 
test, for each of the comparison grade levels of the 1969-1970 school 
year. Comparing Table 15 against Table 14, the results seemed to be 
substantially the same, indicating the PEP students in general scored 
higher on the WRAt than the non-PEP students in Frick School. 

An examination of changes in scores over time should permit 
some assessment of the success of our development effort in improving 
PEP. As the PEP curriculum and its implementation are refined, scores 
should^^iijii>rove. Two years of data were available for the Wfftf^^arten, 
and WRAT scores for these years are compared in Table 16. For the 
two curricular **reas included in the PEP program, arithmetic and read- 
ing (readiness), a substantial improvement from 1969-1970 is observed. 
However, no improvement in the spelling scores is shown. Since we did 
not engage in any developmental work in spelling, no improvement result 
was expected. In general, the effects of deliberate attenHoh paid by the 
LRDC curriculum developers and the school staff to particular curriculum 
areas is reflected in improved achievement scores. 
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TABLE 16 



Comparison of WRAT Achievement of the 
1968-1969 and the 1969-1970 Kindersarten Classes 



KtK tJurnculum 



WRAT Mastery Level 

Group N Reading Arithmetic Spelling Quant ification Classification 

1968-1969 120 0.7 1.0 0.7 28.12 25.61 

1969 1970 103 1.0 1.4 0.6 47.57 53.46 



General Discussion 

Results from this second year of the PEP program at Frick School 
offer grounds for considerable optimism concerning the effectiveness of 
the general approach of the project. Children in the program are, con- 
sidered on the average, clearly mastering the curriculum objectives 
developed for them. Comparisons with older children in the same school 
suggest marked progress toward breaking the cycle of "cumulative defi- 
cit" that IS typically found among children of poor and minority background. 
In general, children using the PEP curricula have median grade equiva- 
lent scores above those expected for their age; children not using the cur- 
ricula have median scores below those expected for their age. The gen- 
eral finding is, then, that the preschoo) kindergarten, and first grade 
children at Frick are responsive to the instruction being offered. They 
are learning what they are taught, and their performance compares favor- 
ably with the comparison groups identified for the study. 
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A particular pattern in the data should be noted and considered at 
this point. This is the fact that improvement in learning appears to be 
highly specific to the areas in which direct instruction was received. 
This specificity effect is seen in several places. The mean WRAT scores 
for spelling, for example, were low for the PEP children as well as their 
non-PEP older siblings and neighbors. This result reflected the absence 
of specific instruction in spelling in the PEP program. The results also 
showed that the first graders did not score as high in the reading subtest 
as they did In the arithm tic subtest, and this reflects the late introduc- 
tion of the formal reading curriculum during the first year of its use--it 
is a difference we hope to see reduced or olin^inated as reading instruc- 
tion becomes more extensive and well-implemented* 

The overall results seem to indicate that PEP is successful in 
teaching the concepts and skills in subject areas in which it specifically 
offers instructions. This particular finding is encouraging. It is encour- 
aging because we have clear evidence that poor-progr.osis children can 
learn standard school curricula when they are systematically and care- 
fully taught, using hierarchically organized mastery curricula. With 
more of this kind of teaching, we should be able to look forward to even 
greater student achievement. However, the lack of generality of lear*M-<; 
to subjects not explicitly taught suggests that one of the early objectives 
of the PEP project (see Resnick, 1967) has yet to be.met; namely, the 
teaching of generalized learning skills that will allow children to prosper 
without the support of highly structured Instruction in every area of 
endeavor. 

This finding sets a major task for future work in individualized 
and adaptive education: the definition of generalized skills of learning 
and the development of ways of teaching these skills lo children of vari- 
ous ages. It also poses an interesting set of research questions surround- 
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ing the relationship of general learning abilities, or "intelligence," and 
school achievement in adaptive settings. Given the specificity of learning 
effects found here, one would expect entering performance in the instruc- 
tional curricula themselves, rather than IQ or other general ability meas- 
sures; to be the major determinants of end of the year learning outcomes. 
Some early evidence on this question is presented in another paper (see 
Resnick & Wang, 1974). Meanwhile, our own work and that of many of 
our colleagues at LRDC is increasingly directed at exploring the relation- 
ships betAveen aptitudes and achievement in adaptive learning environments 
and at the development of ways of enhancing general learning abilities in 
young children. 
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